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SUMMARy 

In  thlB  article  we  dlscuBs  oome  of  the  dlfflcultlee 
arising  In  multi— dlmenBlonal  maximization  probleme  and  some 
of  the  special  types  of  problems  which  can  be  treated  by 
dynamic  programming  techniques.  A  brief  discussion  of  linear 
programming  Is  Included. 
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NULTI-DIMENSIONAL  MAXIMIZATION  AND  DYNAMIC  PROGRAMMING 

By 

Richard  Ballman 


§1.  INTRODUCTION 

In  the  mathematical  domain,  the  word  "eolutlon"  does  not 
have  a  unique  meaning.  As  folncar^  put  It,  one  generation's 
■olutlona  are  another  generation's  problems.  In  the  first  place, 
a  problem  may  be  considered  to  be  solved  If  the  existence  of  a 
solution  can  be  demonstrated.  In  a  number  of  fields,  this  step 
represents  either  an  outstanding  achievement,  or  a  continued 
challenge.  On  the  second  level,  a  problem  may  be  claimed  to  be 
solved  If  an  algorithm  exists  for  obtaining  the  solution.  Most 
of  the  questions  of  analysis  fall  within  this  category.  Finally, 
a  problem  may  be  considered  solved  If  we  possess  a  feasible  algo¬ 
rithm  for  obtaining  the  solution.  The  word  "feasible"  Is  used 
here  to  describe  a  procedure  which  will  yield  the  solution  with 
desired  accuracy  at  a  reasonable  cost  In  time. 

This  last  Is,  of  course,  the  only  fully  satisfying  concept 
of  a  solution,  and  wrs  so  considered  by  Gauss.  In  more  recent 
times,  mathematicians  have  occasionally  been  a  bit  negligent  In 
distinguishing  between  the  second  and  third  levels,  although  a 
great  deal  of  energy  has  continually  been  directed  towards  the 
problem  of  raising  problems  from  the  first  to  the  second  level. 

Fortunately,  throughout  the  years,  the  Incessant  clamor  of 
physicists,  engineers,  economists  and  others  who  have  felt  the 
pressure  of  producing  numbers,  has  had  the  happy  effect  of 


P-1 066 
^14-37 
-2- 


emphaslzlng  to  the  matheicat icien  the  vast  gap  that  exists  between 
these  last  two  levels  of  solution.  The  resultant  challenge  to 
the  mathematician  has  created  a  tremendous  resurgence  of  interest 
in  a  host  of  questions  of  theoretical  and  practical  significance 
that  arise  when  we  attempt  to  proceed  from  the  second  to  the 
third  level.  With  the  advent  of  modern  computing  devices,  the 
scientists  in  all  fields  are  affonded  the  opportunity  to  consider 
and  resolve  problems  which  formerly  appeared  as  far  distant  in 
space  and  time  as  the  star  Sirius. 

To  Illustrate  the  foregoing  remarks,  consider  the  familiar 
problem  of  solving  a  system  of  linear  equations  of  the  fom 


(1) 


‘i/j  *  'i' 


1*1,2, 


It  can  readily  be  shown,  on  the  basis  of  quite  general  and 
abstract  theories  that  a  solution  of  this  system  exists  and 
is  unique  provided  that  the  determinant  of  tne  system,  Ic 

non-zero.  In  addition,  a  number  of  properties  of  the  solution, 
suen  as  linear  dependence  upon  the  Cj^,  can  be  deduced.  This  is 
a  first  level  solution. 


A  second  level  solution  Is  based  upon  Cramer's  rule  which 
exhibits  the  solution  as  ratios  of  determinants.  Thus 


®N1  ®N2 


1* 


with  similar  expressions  for  the  other  x 
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This  l8  an  eltgant  representation  of  the  solution  Mhlch  plajs 
an  iaportant  role  in  many  Investigations.  It  Is  an  algorithm 
since  Me  know  how  to  evaluate  determinants.  It  Is,  however, 
certainly  not  a  feasible  algorithm  for  large  N  of  the  order  of 
100  or  more.  To  see  this,  recall  that  a  determinant  of  degree 
N  expanded  according  to  the  usual  rules  possesses  N!  terms. 

This  proliferation  of  terras  Introduces  two  major  difficulties. 

To  begin  with,  It  consumes  an  appreciable  amount  of  time 
to  add  100!  numbers  together.  To  give  some  crude  Idea  of  what 
a  number  like  this  means  In  computing  time,  obterve  that  Stirling  s 
formula  states  that 

100  _ 

(3)  1001  (100/e)  /ToCv 

100  140 

which  means  that  lOOl  >  (25)  ^  10  Consequently,  if  we 

had  a  super  machine  which  could  multiply  100  numbers  together 

and  add  the  result  to  another  number  In  lO"”^^  seconds,  the 

evaluation  of  a  100  x  100  determinant  would  consume  10^^^  seconds. 

Convert  this  Into  minutes,  hours,  years,  or  mlllenla,  and  the 

result  Is  still  awm-lnaplrlag. 

Assuming  that  some  magic  device  has  been  developed  which 

permits  1001  operations  In  a  short  span  of  time,  we  are  still 

faced  by  the  ogre  of  "round-off  error".  Every  time  we  multiply 

two  numbers  containing  ten  significant  figures  apiece  together 

and  round-off  the  answer  to  ten  significant  figures,  we  commit 

an  error,  and  slmllirly  every  time  we  add  two  such  numbers 

together  we  may  iiave  to  round-off  the  answer.  An  error  of  order 

—10  ' 

of  magnitude  10  committed  100.  times  may  eventually  overwhelm 
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the  anewer,  Itavinc  us  absolutely  nothing  wO  show  for  the  tine 
and  effort  axpendad. 

It  follows  that  the  fonsula  of  Craaer,  so  valuable  for 
theoretical  analysis,  is  totally  useless  for  computational 
purposes.  We  find  ourselves  then  in  the  paradoxical  situation 
where  an  explicit  representation  of  the  exact  solution  of  a 
problem  must  be  discarded,  to  be  replaced  by  techniques  for 
obtaining  the  approximate  solution.  The  reader  who  is  interested 
in  finding  out  how  the  modern  mathematician  escapes  from  this 
dilesma  vlll  enjoy  the  excellent  expository  article  by  Forsythe, 

M- 

Having  seefi  that  the  problem  of  the  solution  of  linear 
systems  of  equations  can  exist  simultaneously  in  all  three  modes 
of  solution,  let  us  now  turn  to  another  equally  basic  problem 
whic..  is  also  tri-valent.  We  shall  devote  the  remainder  of  this 
article  to  a  discussion  of  this  problem. 

Consider  the  problem  of  determining  the  maximum  value  of 
a  function  of  N  variables  F(x^  ,X2»  •  • .  ,Xj^) ,  where  the  Independent 
variables  x^  are  constrained  to  lie  within  some  region  R  which 
may  be  defined  by  means  of  a  set  of  inequalities  of  the  form 

(^)  Gj^(x^,X2»***fXj^)  1  ■  1,2, ...,M. 

As  a  first  level  problem,  the  question  is  readily  resolved. 
If  the  function  is  continuous  over  the  region  R,  and  if  R  is 
bounded,  a  fundamental  cheorem  of  Weierstrass  tells  ts  that  the 
Biaxinum  is  actually  assumed. 

If  each  of  the  variables  x^  assumes  only  a  finite  set  of 
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values,  then  the  existence  of  a  maxisun  Is  rudinentary.  Let  us 
observe  parenthetically  that  It  Is  usually  auch  more  difficult 
to  determine  the  maxlaua  when  the  naxlolzatlon  Is  over  a  discrete 
set  of  points  than  It  is  when  continuous  variation  Is  pemltted; 
see,  for  exaaple,  Tompkins,  [l5]  • 

Let  us  now  add  soae  further  assumptions.  Let  P  be  a 
differentiable  function  of  the  variables  Involved,  and  suppose 
that  the  maxlaua  does  not  occur  on  the  boundary  of  the  region  R. 
Then  the  point  at  which  the  siaxiaum  occurs  Is  to  be  found  as 
one  of  the  solutions  of  the  system  of  simultaneous  equations 

(5)  ^  .  0,  1  "  1.2 . N. 

If  P  Is  a  quadratic  form,  this  system  of  equations  Is  linear, 
which  aeans  that  we  possess  feasible  algorithms.  If,  as  Is 
generally  the  case,  the  system  of  equations  Is  nonlinear,  we 
are  forced  to  use  various  Iterative  techniques,  such  as  the 
gradient  method,  which  are  only  occasionally  successful;  see 
the  Interesting  article  by  Rosenbloom,  [l^j • 

If  some  of  the  maximizing  values  lie  on  boundaries,  or  If 
some  of  the  variables  assume  only  a  discrete  set  of  values,  the 
■ethods  of  calculus  are  only  partially  operative.  At  the 
present  time,  most  problems  of  these  types  appear  to  be  hedged 
about  with  Insurmountable  obstacles. 

In  the  remainder  of  the  paper  we  shall  discuss  some  parti¬ 
cular  mul ti-dlmenslonal  oiaxlmlzatlon  problems  which  can  be 
resolved  by  means  of  a  Judlclo.s  combination  of  high-speed 
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conputtre  and  tht  thaory  of  dynaalc  prograanlng,  [l] ,  [2].  we 
shall  also  brlsfly  santlon  a  quits  isportant  type  of  problea 
that  can  be  trusted  by  Bsans  of  the  theory  of  linear  prograanlng 
and  the  sleplex  technique  of  Dantzlg,  [9].  In  conclusion,  ee 
shall  touch  upon  the  "flooding"  technique  of  Boidyreff,  [6'j. 

§2.  ALLOCATION  OP  RESOURCES 

Let  us  now  consider  the  problem  of  maxlalzing  the  function 

(1)  6i(xi) 

over  all  values  of  the  satisfying  the  Inequalities 

(2)  x^  x^  £  c 

*1^0- 

The  Individual  functions  g^(x^}  are  assumed  to  be  continuous 
for  X,  in  the  interval  [o,cj  .  This  is  the  only  condition  we 
shall  Impose,  since  we  shall  not  employ  any  of  the  methods  of 
calculus . 

This  problem  may  be  considered  to  arise  In  the  following 
fashion.  We  have  a  certain  quantity  of  resources  which  we  wish 
to  allocate  among  N  activities,  with  a  quantity  x^  going  to  the 
Hh  activity.  The  return  from  this  allocation  is  measured  by  the 
funct ions  (x^ ) .  The  problem  is  to  determine  the  x^  so  as  to 
maximize  the  total  return. 

Instead  of  the  usual  approach  which  views  this  as  an  Isolated 
problem,  with  c  a  fixed  quantity  and  N  a  fixed  number,  we  consider 
the  entire  set  of  problems  of  this  type,  allowing  N  to  assume  any 
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Intfger  value,  and  c  any  non-negative  value.  We  then  define 
the  function  of  tMO  variables,  c  and  N,  by  the  relation 

(3) 

Mhere  the  maximum  is  taken  over  the  region  defined  by  (2),  c  ^  0 
and  N  ^  1,2,...,. 

The  simplest  member  of  this  family  of  functions  is  f^(c), 
determined  by  the  relation 

(4)  fi(c)  -  Max  g,(xj  . 

If  we  can  find  a  relation  connectirg  and 

we  can  consider  ourselves  to  have  a  second  level  solution,  since 
iteration  of  this  relation  will  determine  f|^(c)  as  a  function 
of  f^(c)  which  is  known. 

To  obtain  this  recurrence  relation,  let  us  reason  in  the 
following  fashion.  Assuming  that  we  have  allocated  a  certain 
quantity  of  resources,  Xj^,  to  the  Nth  activity,  we  will  have  a 
quantity  of  resources  remaining  which  we  wish  to  divide 

among  the  remaining  activities.  It  is  clear  that  the  remaining 
allocations  are  to  be  made  so  as  to  maximize  the  return  from  the 
remaining  N— 1  activities.  Consequ^^ntly ,  whatever  the  choice  of 
x^  we  must  have  the  relation 

(5)  ^  1 

Since  X|^  is  to  be  chosen  so  as  to  maximize  the  overall  return, 
we  must  have  the  relation 
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The  argument  we  have  used  Is  a  particular  case  of  the 
'’principle  of  optimality",  cf.  [l] ,  [2]. 

Since  f^(x)  is  determined  from  (4),  we  may  compute  f2(j^) 
from  the  above  relation.  Having  determined  r^(x),  we  determine 
and  so  on.  This  determination  is  by  means  of  a  digital 
computer . 

We  have  thus  replaced  the  original  N— dimensional  maximization 
problems.  Experience  with  a  variety  of  problems  has  shown  that 
this  is  a  feasible  algorithm  and  that  we  do  indeed  have  a  third 
level  solution. 


§3-  SEARCH  TECHNIQUES 

If  the  functions  have  no  special  properties,  no 

better  procedure  for  finding  the  maximum  exists  than  the  straight¬ 
forward  examination  of  a  set  of  equally  spaced  points  in  the 
X— range  of  interest.  If,  however,  it  is  known  that  the  function 

concave  then  the  problem  of  determining 
an  optimal  search  pattern  becomes  meaningful.  This  problem.  Itself 
a  dynamic  programming  problem,  has  been  treated  by  S.  Johnson 
and  J.  Kiefer  in  Independent  publications,  [I2]  ,  [l^  .  Interestingly 
enough,  the  Fibonacci  pumbers  play  a  role  in  the  solution.  The 
corresponding  problem  concerning  the  location  of  the  zero  of  a 
concave  function  has  been  treated  by  Gross  and  Johnson. 
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§4 .  A  PACKING  PROBLEM 

A  particularly  Intereatlng  application  of  the  method 
outlined  In  §2  la  to  the  problem  of  determining  the  maximum  of 
the  linear  function 

N 

(1)  ^  ^ 

^  1-1  ^  ^ 

subject  to  the  conetralnta 

(2)  Xj^  —  0fl,2,...,l  — 

N 

L  w  X.  <  w. 

1-1  ^  ^  - 

The  problem  la  a  good  deal  trickier  than  It  appears  due  to  the 
condition  that  the  x^  assume  only  zero  or  Integral  values. 

Although  no  analytic  solution  has  yet  been  given,  the  computa¬ 
tional  solution  la  readily  obtained  using  functional  equations. 

The  question  arises  In  the  determination  of  a  most  valuable 
cargo  subject  to  weight  restrictions. 

§5.  A  SMOOTHING  PROBLEM 

As  a  further  application  of  the  method,  consider  the  problem 
of  determining  the  minimum  of  the  function 

N  N 

(1)  2  ®k^*k“^k-l^  ^ 

k — 1  k  ^  1 

over  all  values  of  the  x^.  This  Is  a  particular  case  of  a  "smoothing" 
problem  where  a  sequence  of  levels  of  activity  must  be  determined 
In  such  a  way  as  to  minimize  the  total  cost  of  maintaining  these 
levels  plus  the  cost  of  transition  from  one  level  to  the  succeeding. 
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Introduclng  the  sequence  of  functions,  »  defined  by 

the  relations 


(2) 


Min 


f^(c)  .  Min  [g^(Xj^-c)  +  h^(x^)  f^^i(xj  1, 

we  readily  obtain  the  computational  solution. 

§6.  ^  EIGEKVALUE  PROBLEM 

The  problem  of  determining  values  of  A  which  permit  non¬ 
trivial  solutions  of  the  boundary-value  problem 


(1) 


u”  Aa(t)u  •  0,  u(0)  ■  u(i)  -  0, 


can,  under  simple  assumptions  concerning  a(t),  be  reduced  to  the 
problem  of  determining  the  relative  minima  of  the  functional 


(2) 


.2 


dt 


subject  to  the  constraints 


(3) 


7.: 


t)«  dt  -  1,  u(0)  -  uU)  -  0. 


A  discrete  version  of  this  problem  Is  the  problem  of  deter¬ 
mining  the  relative  minimum  of  the  quadratic  form 

N 
1 
4 

k« 


(^) 


-  *k-i 


)■ 


subject  to  the  constraint 


N-1 


k-1 


2 

a,  X  -  1 , 
k  k  '0 


0,  x^  - 


(5) 


0. 
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Th«  problem  of  determining  the  absolute  minimum,  which  le  to 
say  the  omallest  characteristic  value,  Is  one  which  can  be 
approached  by  means  of  the  technique  exhibited  above.  Further 
details  may  be  found  In  [l],  1 3]  . 

§7.  Tffi  CALCULUS  OP  VARIATIONS 

Similarly,  more  general  problems  In  the  calculus  of  variations. 
Involving  the  minimization  over  all  functions  y  of  a  functional 
of  the  form 

(1)  y^P(x,y,8)de 

0 

Bubject  to  constraints  of  the  form 

(a)  -‘5£  -  G(x,y,t),  x(0)  -  c, 

dt 

and 

(3)  R(x,y)  1  0 

can  be  treated  by  means  of  functional  equation  techniques.  Since 
any  discussion  of  this  would  take  us  too  far  afield,  we  refer  the 
reader  to  [l] ,  [4],  [5],  where  further  discussion  and  applications 
may  be  found. 

§8.  ALJXCATION  OP  TYPES  OF  RESOURCES 

Let  us  now  consider  the  problem  of  maximizing  the  function 

h)  "n  - 

subject  to  the  constraints 


X  x^  ^  X,  ^  0, 

^  ^  y>  >  0, 


(2' 
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whlch  ariBCB  from  allocation  problemB  Involving  two  typeB  of 

reBourcBB . 

Introduce  the  eequence  of  functlone  of  two  varlablee 
(5)  -  Max  K^, 

k-1,2,...,  x,y,  >0, 

where  the  maximization  Ic  over  the  above  region. 

Then 

(^)  fj^(x.y)  -  Max  [  ^k-1  ^^“^k '^'^k 

with 

(5)  fi (x*y)  -  Max  g, (x,  ,y,  )  . 

0^x^<x  ^  ^  ^ 

o^yi^y 

ProblemB  Involving  tne  computation  of  eequencee  of  functlone 
of  two  or  more  variables  are  very  much  more  complicated  than  thoee 
Involving  the  computational  eolutlon  of  sequenceB  of  functlone 
of  one  variable.  For  problemB  of  the  type  described  above,  a 
combination  of  the  Lagrange  multiplier  technique  and  the  functional 
equation  method  of  dynamic  programming  hae  proved  quite  Bucceeeful, 
Bee  [6] . 

§9-  LINEAR  PROGRAMMING 

The  problem  of  allocating  a  large  number  of  reeourceo  leadB 
to  the  question  of  maximizing  the  linear  function 
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8ubJ«ct  to  a  strlea  of  constraints  of  the  form 

c,,  1  .  1, M, 

under  suitable  asaumptl'^  ns  of  linearity  concerning  the  cost  and 
return  functions.  In  addition,  a  great  variety  of  other  problems 
that  arise  in  economic  and  Industrial  life  Involving  the  scheduling 
of  operations  can  be  cast  In  this  form. 

Although  the  functional  equation  approach  yields  a  second 
level  solution,  in  the  form  of  an  algorithm  based  upon  recurrence 
relations,  this  approach  Is  not  at  all  feasible  for  large  values 
of  M. 

A  method  of  an  entirely  different  type  has  been  developed 
by  0.  Dantzlg,  and  considerably  extended  by  D^^ntzlg  and  others. 

This  method,  called  the  "simplex  method".  Is  based  upon  the 
linearity  of  the  functions  Involved,  see  [9]. 

§10.  "PLOODINO"  TECHNIQUE 

A  number  of  scheduling  problems  arising  In  transportation 
theory,  see  [7]# give  rise  to  problems  of  the  type  mentioned 

t 

above.  Some  of  these,  such  as  the  HI tchcock— Koopmans  transpor¬ 
tation  problem  may  be  solved  In  very  elegant  and  rapid  fashion 
by  means  of  the  simplex  technique.  Come,  on  the  other  hand, 
require  Iterative  techniques  specifically  adapted  to  the  problem 
mt  hand.  A  technique  of  this  type,  reminiscent  of  the  relaxation 
technique  of  Southwell,  has  recently  been  developed  by  Boldyreff, 
the  "flooding  technique".  A  discussion  of  it  may  be  found  In  [b] . 
Work  on  the  saae  problem  which  gave  rise  to  this  technique. 


P-1086 

a  transportation  problem  of  Harris,  has  also  resulted  In  the 
development  of  modifications  of  the  simplex  technique  which 
are  useful  In  treating  a  number  of  other  problems  as  well.  These 
results,  due  to  Ford  and  Fulkerson,  may  be  found  In  [^ . 
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